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Period for Reply 



A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) OR THIRTY (30) DAYS, 
WHICHEVER IS LONGER, FROM THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

• If NO period for reply is specified above, the maximum statutory period v^ill apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1 .704(b). 

Status 

1)K Responsive to connmunication(s) filed on 28 July 2005 . 
2a)\Z\ This action is FINAL. 2b)^ This action is non-final. 

3) n Since this application is in condition for allowance except for fomnal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 1 1 , 453 O.G. 213. 

Disposition of Claims 

4) S Claim(s) 19-36 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) 0 Claim(s) is/are allowed. 

6) 13 Claim(s) 19-36 is/are rejected. 
?)□ Claim(s) is/are objected to. 

8) 0 Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) 0 The specification is objected to by the Examiner. 

10) 0 The drawing(s) filed on is/are: a)n accepted or b)n objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 
Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 

11) 0 The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 

Priority under 35 U.S.C. § 119 
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1 .□ Certified copies of the priority documents have been received. 

2. \3 Certified copies of the priority documents have been received in Application No. . 

3. n Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 
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Information Disclosure Statement 

1 . The information disclosure statement filed 4-23-01 fails to comply with 37 CFR 
1.98(a)(2), which requires a legible copy of each cited foreign patent document; 
each non-patent literature publication or that portion which caused it to be listed; 
and all other information or that portion which caused it to be listed. It has been 
placed in the application file, but the information referred to therein has not been 
considered. Non patent literate enlisted under AE-AH of the PTO-1449 form are 
missing. 

Claim Rejections - 35 USC § 102 

2. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(e) the invention was described in (1) an application for patent, published under section 122(b), by 
another filed in the United States before the invention by the applicant for patent or (2) a patent 
granted on an application for patent by another filed in the United States before the invention by the 
applicant for patent, except that an international application filed under the treaty defined in section 
351(a) shall have the effects for purposes of this subsection of an application filed in the United States 
only if the international application designated the United States and was published under Article 21 (2) 
of such treaty in the English language. 

3. Claims 19-32, 35-36 are rejected under 35 U.S.C. 102(e) as being anticipated by 
Brodsky (US Pat. 5,809,471). 

In regard to claim 19, Brodsky discloses a method for searching in a 
multimedia signal (see Brodsky: column 1, lines 50-56, lines 60-62), wherein the 
multimedia signal includes at least a first data format component (extracted 
closed captioned text) and a second data format component (retrieved additional 
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information; see Brodsky: column 1, lines 66-67, column 2, lines 20-23, column 
3, lines 17-21), the method comprising: 

Receiving a search parameter (see Brodsky: column 2, lines 5-9); 
Analyzing the first data format component of the multimedia signal to identify the 
occurrences of the search parameter (see column 2, lines 25-27, lines 30-32, 
lines 60-62); and 

For at least one occurrence of the search parameter in the first data component, 
presenting a corresponding second data format segment of the multimedia signal 
(see column 2, lines 35-39, column 3, lines 33-36). 

In regards to claim 20, the first data format component is a closed caption 
component (see column 2, lines 20-23, column 5, lines 36-37), and wherein the 
second data format is an audio component (see column 4, lines 19-23). 

In regard to claim 21 , t the corresponding second data format segment is 
a section of the audio component that begins and ends within a predetermined 
period of time (i.e. a search is created on the recently received portion; column 4, 
lines 27-30) before and after the occurrence of the search parameter in the 
closed caption component (see column 3, lines 52-56, lines 60-67 and column 4, 
lines 1-3). 

In regards to claim 22, the first data format component is a closed caption 
component (see column 2, lines 20-23, column 5, lines 36-37) and wherein the 
second data format component is a video component (see column 4, lines 19- 
23). 
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In regards to claim 23, the corresponding second data format segment is a 
section of the video component that begins and ends within a predetermined 
period of time before and after the occurrence of the search parameter in the 
closed caption component (see column 3, lines 52-56, lines 60-67 and column 4, 
lines 1-3, lines 27-30). 

In regards to claim 24, the corresponding second data format segment is a 
still image from the video component (still image is anticipated by the scope of 
selective picture) that is present at the occurrence of the search parameter in the 
closed caption component (see column 3, lines 34-37). 

In regards to claim 25, the first data format component is an audio 
component and the second data format component is a video component (see 
column 3, lines 56-58; column 4, lines 19-23). 

In regards to claim 26, the formats of the first data format component and 
the second data format component are selected from the group consisting of: text 
data; closed caption data; audio data; speech data; video data (see column 4, 
lines 19-23) 

In regards to claim 27, the step of receiving a search parameter further 
comprises receiving the search parameter in a third data format (i.e. spoken 
words, voice format; see column 6, lines 24-26); and converting the search 
parameter from the third format to the first format (using voice recognition 
technique inherently involves converting the input voice signal into another 
format; see column 4, lines 62-67 and column 5, lines 1-3). 
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In regards to claim 28, the format of the third data format component and 
the first data format component are selected from the group consisting of: text 
data; closed caption data; audio data; speech data; video data; (see column 4, 
lines 19-23) 

In regards to claim 29, Brodsky discloses the method for processing data 
in a multimedia signal (see column 1, lines 50-56, lines 60-62), comprising: 
Analyzing a first data format component of the multimedia signal to identify the 
occurrences of a search parameter (see column 2, lines 25-27, lines 30-32, lines 
60-62); 

For at least one occurrence of the search parameter in the first data component, 
identifying a corresponding segment of a second data format component in the 
multimedia signal (see column 2, lines 35-39, column 3, lines 33-36); 

In regards to claim 30, the second data format component is a video 
component (see column 4, lines 19-23); the method further comprising the step 
of displaying the segment of the video component to the user (see column 3, 
lines 34-37); 

In regards to claim 31, the segment of the video component is a single 
image (still image is anticipated by the scope of selective picture; see column 3, 
lines 34-37). 

In regards to claim 32, the segment of the video component is a video clip 
of predetermined length (i.e. recently received portion) that corresponds to an 
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occurrence of the search parameter in the first data component; see column 4, 
lines 27-30, column 3, lines 52-56, lines 60-67 and column 4, lines 1-3. 

In regards to claim 35, the first data format component is a text component 
(see column 2, lines 20-23, column 5, lines 36-37) and the method further 
comprises the steps of: 

Receiving the search parameter in an audio format (see column 6, lines 24-26); 
and 

Converting the search parameter to a text data format prior to analyzing the 
multimedia signal (see column 4, lines 62-67 and column 5, lines 1-3). 

In regards to claim 36, the voice recognition performs the converting step 
converting step using a speech to text converter since the first data format is a 
text component (see column 5, lines 37-38) and the search parameter is in audio 
format (see column 6, lines 24-26). 

Claim Rejections - 35 USC § 103 

4. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

5. Claims 33-34 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Brodsky (US Pat. 5,809,471). 

In regard to claim 33, Brodsky discloses that the first data format 
component is an audio component (see column 4, lines 18-22) and further 
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comprises various forms of search request, including selection from a visual 
menu. 

Brodsky does not disclose that the selection from a visual menu can be in 
a text format. 

Examiner takes official notice that a search request generated by selection 
from a visual menu can be in text format. 

It would have been obvious to one of ordinary skill in the art at the time of 
the invention to modify the system by requesting a search in a text format; and 
further converting the search parameter to the data format of the first data (i.e. 
audio data) in order to analyze the multimedia signal The motivation to use a 
text format search is to allov\/ the user to select various words that maybe present 
in closed captions. 

In regards to claim 34, the modified system converts text data into audio 
data using a text to speech converter. 

Conclusion 

6. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Usha Raman whose telephone number is (571 ) 
272-7380. The examiner can normally be reached on Mon-Fri: 9am-6pm. 

If attempts to reach the examiner by telephone are unsuccessful, the 
examiner's supervisor, Christopher Kelley can be reached on (571) 272-7331. 
The fax phone number for the organization where this application or proceeding 
is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from 
the Patent Application Information Retrieval (PAIR) system. Status information 
for published applications may be obtained from either Private PAIR or Public 
PAIR. Status information for unpublished applications is available through 
Private PAIR only. For more information about the PAIR system, see http://pair- 
direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll- 
free). 




